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Optimal operation of feedback flashing ratchets 
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Feedback flashing ratchets are thermal rectifiers that use information on the state of the system 
to operate the switching on and off a periodic potential. We discuss different strategies for this 
operation with the aim of maximizing the net flux of particles in the collective version of a flashing 
ratchet consisting on N overdamped Brownian particles. We show the optimal protocols for the 
one-particle ratchet and for the collective ratchet with an infinite number of particles. Finally we 
comment on the unsolved problem of the optimal strategy for any other number of particles. 
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I. INTRODUCTION 
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Brownian motors or ratchets are rectifiers of thermal fluctuations that induce direct transport without an a priori 
bias The breaking of thermal equilibrium and of certain time-space symmetries are necessary conditions to 
manage direct transport 0, S 0] • Ratchets are relevant from the theoretical point of view to study non-equilibrium 
processes, and from a practical point of view due to their applications in nanotechnology and biology [l|, [H, Q. A 
prototypical example of a ratchet system is the so-called flashing ratchet, which is based on switching on and off a 
periodic potential 0, @|. The spatial asymmetry of the potential ensures a direct transport, but also a symmetric 
potential under an intrinsically asymmetric operation for the switching can achieve this task. Figure [T] illustrates the 
operation of a flashing ratchet. 
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FIG. 1: Illustration of a flashing ratchet operation. The ratchet potential depicted has spatial period 1 and 
asymmetry a = 1/3. The thick lines represent the probability density of a Brownian particle initially at one of the 

minima of the potential (top). When the potential is switched off the particle begins to diffuse isotropically 
(middle) . After the potential is switched on again a net flux to the right is obtained due to the asymmetry of the 

potential (bottom). 
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Control strategies such as those obtained with a time periodic or random switching are open-loop control policies, 
as they do not use any information about the particle distribution of the system to operate. Some studies deal with 
the optimal modulation in time of ratchet potential to maximize the performance of these open- loop systems [j| ■ 
These works uses a variational approach to optimize the velocity induced by deterministic modulation in time of the 
potential. 

On the other hand, it has been shown that a significant increase for the net flux in a flashing ratchet can be obtained 
if feedback on the state of the system is used by the protocol that switches on and off the ratchet potential [ll[ (i.e., 
taking into account the positions of the Brownian particles before the switching operation). This can improve the 
technological applications of ratchets. Experimental implementations of these feedback (= closed-loop control) flashing 
ratchets have been proposed (l2l. Il3l. ITij . and the realization of such devices is currently under way [14.ll5l |. In addition, 
feedback ratchets have been suggested as a mechanism to explain the stepping motion of the two-headed kinesin [l6| 
and are also present in other chemically-driven molecular motors [l?], [H, Ell • 

In this context, determining the optimal protocol for the operation of collective feedback ratchets is a relevant 
question that has only received partial answers. In the present work we review and compare some control strategies 
designed with the aim of maximizing the net flux of particles. We show the optimal protocol for the one-particle 
flashing ratchet and for the limit case of an infinite number of particles. In the following section we present the Langevin 
equations standing for the feedback ratchet. After that, we revise the instant maximization protocol (Sec. IIII[) , the 
threshold protocol (Sec. IIV[) . and the maximal net displacement protocol (Sec. [Vj) . We finally discuss the main 
unsolved questions related with the optimal operation of these systems (Sec. IVl)) . 



II. COLLECTIVE FLASHING RATCHET 



A collective flashing ratchet can be modeled by N Brownian particles at positions {xj(t)} that satisfy the over- 
damped Langevin equations 

1 x i {t)=a{{x j (t)},t)F(x i {t))+£ i (t); i=l,...,N. (1) 

Here, F{x) = — V'(x), with V{x) the so-called ratchet potential, which is usually spatially periodic, V(x) — V(x + L), 
and has broken symmetry x — > —x. In these equations £,i(t) stand for Gaussian white noises of zero mean and variance 
(£i(t)£,j(t')) — 2~fkBT6ij5(t — t 1 ), with 7 the viscous friction coefficient. The function a(t) implements the action of a 
controller that switches on the ratchet potential (a = 1) or switches it off (a = 0). Thanks to this switching, detailed 
balance symmetry is broken and the system can act as a Brownian motor. Note that, even for symmetric potentials 
V(x) = V(— x), there can be ratchet effect provided the control policy induces the required asymmetry. 
A common ratchet potential is 



V(x) = V(x + L) = 2U 
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which has height Vo and asymmetry parameter a = 1/3 (with aL the distance between a minimum and the next 
maximum). This potential has been used in figure [1] to illustrate the flashing ratchet effect. 

It is worthwhile to point out that there is no dependence of the average flux with the number of particles for 
open-loop control policies, as the Langevin equations are decoupled. However, for closed-loop ratchets the feedback 
strategy introduces a coupling between the particles dynamics, and the center-of-mass velocity does depend on N. 



III. THE INSTANT MAXIMIZATION PROTOCOL 



In the instant maximization of the velocity protocol the control policy depends on the sign of the net force per 
particle at each instant of time. More specifically, the potential is switched on if the net force the particles would feel 
with the potential 'on': 

1 N 

1=1 

is positive, and the potential is switched off otherwise. Thus 



a(t) = 0(/(t)), 



(4) 
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with 9 the Heaviside function [0(x) = 1 if x > 0, else @(x) — 0]. 

For a one-particle ratchet this protocol gives the maximum possible flux, i.e., it is the optimal protocol for N = 1. 
Let us call x the cyclic coordinate of the particle (modulo L). Then, the instant maximization protocol just consists 
of switching on the potential whenever the particle is in a region with a positive slope of the potential, x £ (aL, L), or 
switching off the potential whenever the particle is in a region with a negative slope, x G (0, aL). Hence the system can 
be reinterpreted as a Brownian particle that freely diffuses in the flat regions (aL, L) and 'slides down' in the biased 
regions (0, aL). Now it is clear that the instant maximization protocol is the optimal strategy for the one-particle 
ratchet, as any changing in the prescription a(x(t)) would imply either changing the flat regions to uphill potential 
barriers or change the downhill regions to plateaus. A similar argument allows us to proof the more general statement 
that the instant maximization protocol beats any general protocol a(x(t),t), even with an explicit dependence in t 
and a varying in the range [0,1] (pulsating ratchets). From the Langevin equation {I}, with N = 1, the average 
steady state velocity is formally computed as 

(x)= lim — / a(x(t),t)F(x(t)) dt. (5) 

On the other hand, the effective force including the action of the controller in the instant maximization operation is 
Q(F(x(t)))F(x(t)), so that at each instant of time t the inequality 

a(x(t),t)F(x(t)) < Q(F(x(t)))F(x(t)), (6) 

holds for any control < a(x(t),t) < 1, as the maximum value for a positive (negative) force is obtained when the 
control parameter is a = 1 (a — 0) . We finally combine inequality ^ and equation ([5]) , which proves the optimality 
of the instant maximization protocol. 

However, for a large number of particles the system dynamics gets trapped with the potential 'on' or 'off', as the 
fluctuations of the magnitude of f(t) — which trigger the switches — become smaller Therefore useless waiting 
times with the particle distribution near the equilibrium are wasted after the next switching. For a thousand particles 
the instant maximization protocol gives a lower flux than a simple periodic switching strategy that does not receives 
any feedback from the system. In the end, the flux goes to zero as N increases; see figure [2j 



IV. THE THRESHOLD PROTOCOL 

The undesired trapping of the many-particle dynamics is settled in the threshold protocol [20l . [2l| . in which the 
potential switchings are forced, provided the magnitude of the net force is below certain threshold values and the 
system is in an unproductive state near equilibrium. 

Let us call u on > and u Q g < the thresholds values that induce switchings off and on when the decaying long 
tails of f(t) are still positive or negative, respectively. Then, the threshold control is given by 

'1 if/(*)>«aa, 

/.s _ I 1 if "off < fif) < u on and f exp [t) > 0, , . 

a[ ' ~ } if u off < "A / / M ^ n 
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The condition over the sign of the derivative of the net force ensures that the switchings are only enforced when the 
system is really relaxing to equilibrium. This derivative is obtained by applying the Ito chain rule to the stochastic 
magnitude f(t) [U[2l[: 

/exp(t) = ±'£a{t)F(x i (t))F'(x i {t)) + ^f5>"Mi)). (8) 

i i 

The instant maximization protocol — optimal for N — 1 — is recovered by taking zero threshold u n = u Q g = 0. On 
the other hand, for an adequate value of the thresholds, this new strategy gives the same flux as the optimal periodic, 
open-loop switching protocol for an infinite number of particles. Note that for N — > oo no appreciable advantage 
over the optimal periodic switching can be obtained by using a feedback scheme, as only one degree of freedom is 
performed in the control (switching on and off). Therefore, the family of threshold protocols succeeds in getting the 
optimal control both for the one particle case and for the infinite particle case, yielding in between fluxes greater 
than or equal to open-loop protocols for all numbers of particles. In fact, the specific thresholds u on and u on = that 
are optimal for N — > oo also give a high value for the flux close to the value corresponding to the best thresholds for 
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FIG. 2: Stationary center-of-mass velocity as a function of the number of particles for the instant maximization 
protocol and for the threshold protocol with optimal thresholds for N — > oo. The dashed line stands for the periodic 
switching protocol with optimal periods. Units: L — 1, 7 — 1, k^T = 1. We have used the ratchet potential @ with 
potential height Vq = 5. For this system the optimal thresholds for N — > 00 are u on ~ 0.6 and u Q g ~ —0.4. The 
estimated optimal semiperiods for the on and off times of the periodic protocol are 0.06 and 0.05, respectively. 

finite N (2l| . Figure [21 shows the flux dependence with the number of particles for the instant maximization protocol 
and the threshold protocol with optimal thresholds for N — > 00. The flux is also compared with the ./V-independent 
value for the best open-loop, periodic switching protocol. 

V. THE MAXIMAL NET DISPLACEMENT PROTOCOL 

The previous feedback control strategies are based on the distribution of the forces {F(xi)}. But other choices are 
also possible. For instance, in the so-called maximal net displacement protocol [3| the control parameter depends on 
the particle distribution as follows, 

N 

a{t) = 0(d(t)); d(t) =^2(xi(t) - x ), (9) 

1=1 

where £0 is the mean of a Gaussian distribution at equilibrium in the ratchet potential V{x). This new protocol 
was numerically found [3] to slightly beat the instant maximization protocol for collective ratchets of two and three 
particles and potential heights > 30fcsT. However, it performs worse for other numbers of particles or smaller potential 
heights. 

VI. DISCUSSION AND OPEN QUESTIONS 

The previous results provide some partial answers to the question of the optimal operation of feedback ratchets 
to maximize the flux. The appropriate introduction of feedback policies in collective flashing ratchets improves the 
performance of the system for a finite number of particles. In particular, the instant maximization protocol (llj is 
the optimal operation for the one-particle ratchet, as we have proven. However, this 'greedy' strategy is not optimal 
for the collective version of the ratchet. This kind of short-range maximization has also been reported not to be 
optimal in the so-called paradoxical games [22I [23| . On the other hand, in the limit of an infinite number of particles 
no advantage over open-loo p st rategies can be achieved by using any feedback in the system. Our results also show 
that the threshold protocol |20l.l2~fl| with proper threshold values is optimal for N = 1 (zero thresholds) and N — > 00, 
and it can give large values of the flux for intermediate number of particles. It is interesting to note that an exact 
optimization study in the framework of a discrete ratchet-like systems revealed that the optimal protocol is indeed a 
kind of threshold operation [23| . 
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Despite the advance that these partial answers represent, the fundamental problem — which is the optimal protocol 
for a collective feedback flashing ratchet — is still unsolved. A systematic study about the maximization of the flux in 
these systems using either the stochastic version of the Pontryagin maximum principle or the stochastic version of the 
Bellman's dynamic programming [24j is still lacking. On the other hand, we point out that adding another external 
perturbation to the feedback flashing ratchet can enlarge the flux of the system, as it happens, for instance, when a 
feedback flashing ratchet is rocked with proper amplitude and frequency [23]. We also point out that, to the best of 
our knowledge, there is still no study of the effects of inertia in feedback ratchets. These studies will also broaden the 
implications and applications of feedback ratchets. 

Finding the optimal protocol of feedback ratchets would be an important theoretical task, as these systems are 
nothing other than Maxwell's demons [26| ; thus it would give a paradigmatic example to illustrate the maximum 
performance that can be attained by using a certain amount of information obeying thermodynamic restrictions. On 
the other hand, there is also an increasing interest in feedback flashing ratchets as nanotechnological devices (see [l4| 
for a description of two set-ups capable of implementing a collective feedback flashing ratchet; one of these experiments 
has been very recently done [HI). In addition, the maximization of the instant velocity, which is optimal for N = 1 
as we have proved, has allow one to get an insight into the motion of a linear, two headed, processive molecular 
motor [l6| . A deep knowledge of the maximum flux that can be attained in feedback flashing ratchets could also help 
to get insight into other biological systems, such as molecular motors operating in a collective way [27| . 
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